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This application was filed on 20 - 11 - 1997 as a 
divisional applicatk)n to the appUcatk}n mentioned ^ 
under INID code 62. 



(54) Memory system for use In an image data processing apparatus 



(57) A vkleo data processing apparatus converts 
one of NTSC type and VGA type vkleo signate to the 
other or overlays the two types of vkieo signals and out- 
puts them as either an NTSC type ovedaki vkleo signal 
or a VGA type overlakl vkleo signal The memory sys- 
tem has two video memories (156. 174) for storing 
vkleo signal data. One of the two video memories stores 
solely VGA tape video data. The othe^ video memory 
stores either VGA type vkleo data or MTSC type video 
data depending upon the partk:iiar functton bting car- 
ried out by the processing apparatus. Vkleo data may 
t>e read out from the other video memory using diff^-ent 
scan rates so that an Indivklually dedicated memory is 
not reqUred for each type of vkleo date in peribmiing 
the above-mentioned conversations and overlays. 
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Description 



The present invention relates to a memory system 
tor use in an apparatus for mixing image signals and 
more particularly to an apparatus for mixing a signal 
representative of a graphics image generated by a com- 
puter and a video signal such as an NTSC signal or ttie 
like, representative of a real image. The Invention also 
relates to an apparatus for converting a signal repre- 
sentative of a graphics Image into a video signal repre- 
sentative of a real image and vice versa. 

Imaging systems avaOable today include one in 
which, for example, a telewston (TV) signal generated 
by a TV camera or a video signal recorded on a video 
floppy disc by an electronic stiH camera is mputted to a 
computer system to be displayed on a monitor in a par- 
tiojlar fbmi such as. lor exai^pie. a video graphics array 
(VGA) form. This prior art imaging system (US-A- 
4,956.707) as shown in Figure 7 includes a personal 
computer 10 and an image recording and reproducing 
device 1 2 which are intei«K:ed to each otfier by an elec- 
tronics board 97. When recording and r^wodudng 
device 1 2 is loaded witfi a video floppy disc 1 8 to read a 
video signal r^resentative of a real image, the video 
signal is transformed into oorrespondmg digital date t^ 
an analog-to digital converter 98 of electronics board 97 
and then developed as bit-mapped data in a dedicated 
video frame memory 99 ateo included in the elecbonics 
board. The personal comfHrter 1 0 may tiien fetch the bit- 
««apped data later as needed and. thereafter, hancSe 
the data as a VGA inage inducfing displaying tfie data 
on VGA monitor 16. 

Also, graphics in a VGA format generated by a per- 
sonal corputer may be converted to video signals 
capable of being recorded on a video floppy dtsc by an 
electronic still camera using conventional techniques as 
^ownin Rg. 6. in ff=ig. 6. PC graphics are stored in a 
dedicated ajftor 1 and are read out by scan cwwerter 2 
along Gne 3 using a read-out rate d^endent on ttie par- 
ticular type of video signal fomiat desired. In ttie figure 
an NTSC video signal capable of being recorded on a 
video floppy disc is showwi as an output of scan conveler 
2. However, different scan rales, for examale. PAL or 
8ECAM scan rates, may also be used. The resultant 
NTSC signal in ttie figure niE^ tfien be displayed on 
NTSCmonrlor24. 

As shown in Figs. 6 and 7. ft Is known to provide a 
conversion from VGA to NTSC and vice versa How- 
wer, using ttie cIrcuHs of Figs. 6 and 7. separate and 
independent hardware is reqiired to store tfie video sig- 
nal in its present state before ft is converted. For exam- 
ple, in Rfl. 6 a defeated PC QrapNcs Buffer 1 must be 
provided to store ttie VGA signal before ft is cdnverted 

to IMTBC tiy scan converter 2 since ttie VGA data must 
be ananged in a predetermined way so ttiat ttie fosd 

rate scan converter 2 may properly access ft in Oder to 
transform ttie signal to NTSC. Ltowise, in Fig. 7 a ded- 
icated frame memory 99 must be provided to store an 



NTSC sgnal before it is converted to VGA by ttie fixed- 
rate read-out operatwn of personal conputer 1 0. There- 
fore, a large amount of hardware is needed in order to 
convert NTSC video signals to VGA and vice versa 
s It is also known (WO-A 88/073 1 0) to insert (overiay) 
a computer graphics (VGA) signal in selected locations 
of an NTSC image and to display ttie tttus-conttned 
video s^nal onto an NTSC monrtor such as a conven- 
tional TV receiver. Such a conventional system is shown 
10 in Fig. 8. An int^ced NTSC video signal is k^M to 
input terminal 202 and supplied to video combiner 203. 
A synchronization conponenl of the irput f^SC video 
signal is suppGed to Qen-tock drcuftry 201 which pro- 
vides an output to video fonnat converter 200. Non- 
is interlaced VGA signals are pre-stored in PC ^^ics 
m«iiory 100 and are supplied to scan-rate converter 
200 which mocfifies ttie scan rate of ttie irput non-lnter- 
teced VGA signals based on tfie output of ttie Gen4ock 
drctitry 201. The Gen-lod< circuitry 201 receives ttie 
so synchronization component of an input video signai, in 
ttiis case NTSC. and provides an output to video tbnrat 
converter 200 so that ttie converter 200 can modify ttie 
fomiat of its input, in ttils case VGA from PC graphics 

wwmory 100. so ttiat ttie output of ttie converter 200 has 
25 a fomiat equal to tfie input signal to ttie Gen-tock cir- 
cuitry 201. 

In Rg. 8 ttie converter 200 modifies tfie non-inter- 
laced VGA input Into interlaced VGA in ttie NTSC Ibmiat 
and supplies ttie interlaced VGA to Video combine 203 

30 At ttis point ttie VGA Signal is Of tfie same fomiat ae. 
interlaced) as tfie WSC video s^nal which is also sup^ 
pBed to video combiner 203. The ou^ 204 of com- 
biner 203 is an Interlaced VGA signal overlaid onto an 
NTSC signal. 

35 ft also known to overlay NTSC video ^gnals onto 
VGA signals and to display ttie resim onto a VGA moni- 
tor using prfor art systems. However a dedicated VGA 
Buffer and a dedicated NTSC video memory ara 
requored to ttie prior art systems. 

^ Asisdearfiromthedescripttonofthepriorartsys- 
tews above, a s^>arete and dedicated frame memory 
or Buffer Is required to hold eac^ type of image signal, 
stoce a different type of image signal has a different for- 
mat fi.e, interiaced or non-inteilaced). For emnple, in 
^ Rg. 7 a separate dedicated frame memory 99 is 

required to store ttie NTSC s^nal bdbre ft is converted 
to VGA. Further, a separate and dedicated PC G^lcs 
buffer (1, 100) is required in Figs. 6 and 8, respecfively 
fli order to store VGA signals. 
so Since dedicated Buffers or memories have been 
required by ttie prior art a large amount of hardwve is 
necessary in order to provide image signal processing 
^' y^ e^t capable of handOng a variety of image s^nal 
formats. 

ss As descrbed above. Ima^ng systems avaibble 
today (IEEE Transacttons on Consum©^ Electroracs 
35(1989) Na3, pp 624 to 628) include one in which fo^ 
exanple. a television (TV) signal generated by a TV 
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camera and a video signal recorded in a video f lopr^ by 
an electronic still camera are inputted to a computer 
system to be displayed on a monitor in a particular form 
such as a Video Graphics Array (VGA) image. This prior 
art imaging system includes a personal computer and 5 
an image recording and reproducing device which are 
interfaced to each other by an electronics board. f=br 
example, when the recording and reproducing device is 
loaded with a video floppy to read a video signal repre- 
sentative of a real image, the video signal is trans- 10 
formed into corresponding digital data by tie electronics 
board and then developed as bit-mafi|:»ed data in a 
video memory included in the ele€$^f';s board. The 
personal computer may fetch the^bfenapped data later 
as needed and, thereafter, handle ihe.-.i<as VGA image 15 
or a part thereof. 

The conventional system in which a personal com- 
puter and an apparatus for recording and reproducing 
images from a video floppy are combined allows video 
data to be transferred from the recording and reproduc- 20 
ing apparatus to the personal computer, it does not 
allow the transfer thereof from the personal computer to 
the recording and reproducing apparatus. Specifically, 
with such a system, it is irrpossible to read a real image 
out of a video floppy, process it in the personal compu- 2S 
ter. and then write the processed image again to the 
video floppy. 

With the increasing spread of computer systems 
and video systems, there is an increasing demand 
among users for an inplementatibn which makes the so 
most of various merits available with the combination of 
the two different systems. For exanple. It is often 
desired to see the contents of images stored in a video 
floppy, video tape or similar image recording medium 
instantaneously in a summarized image. It Is also ss 
desired to add a title or bibOographic item to such a 
summarized image and then write the result bade to the 
same recording medium. 

In the above-mentioned system, video output sig- 
nals representing a mixture of a computer graphics 40 
(VGA) image and an IMTSC-type image are easily dis- 
played on a selected one of a computer graphics (VGA) 
type monitor or an MTSC-type monitor. However, the 
combined (overlaid) video Image signals are not so eas- 
ily sent on to an external memory. Difficulties arise in 45 
attempting to store an overlaid video signal in an exter- 
nal memory because the speed of the overlaid signal as 
it comes out of the above-mentioned video processing 
system is too fast for an external memory to handle. For 
example, the overlaid signals are sent out at a rate in so 
the Megahertz (MHz) region. It would be useful to be 
able to store overfaid images in an external memory as 
an alternative to merely displaying the overlaid image 
onto a monitor display By storing overlaid images in an 
external memory they would be able to be easily and ss 
selectably read out and displaced on a monitor at a later 
time without having to re-overlay the image signals 
making up the composite overlatd signal. ATso. further 



processing or overlaying of the overlaid signals would 
be simplified. 

A vWeo signal processing apparatus has been 
described in a co-pending application entitled "Video 
Processing System Memory for Storing a Variety of 
Video Signal Formats" and filed in the name of the 
same applicant as that of the present application and 
involves a system for converting one of NTSC type and 
VGA type video signals to the other or overiays the two 
types of video signals and outputs them as either an 
NTSC type overlaid video signal or a VGA type overlaid 
video signal. The processing system has two video 
memories storing video signal data. One of the two 
video memories stores solely VGA type video data. The 
other video, memory stores either VGA type, video data 
or NTSC type video data depending upon the partk^ular 
function being carried out by the processing system. 
Video data may be read out from the other video mem- 
ory using different scan rates so that an individually 
dedicated memory is not required for each type of video 
data in perfornmg the above-mentioned oonversions 
and overlays. 

In the above-mentioned system, howev^. the video 
signal output of the overlay and rescan board can only 
be sent to one type of monitor, the monitor capable of 
handling the scan rate of the ftx)ard*s output video sig- 
nal. 

fvrrSC-type video signals exist in an interlaced for- 
mat where the scan lines of one of two fields of a frame 
of video data are displayed on a monitor and the scan 
lines of the other f iekJ are interlaced between the scan 
lines of the first field. The interlacing effect makes a sig- 
nal easier to view from a large distance since glare is 
reduced by dispensing local intensities within a signal. If 
this intertaced cfisplay is viewed from a ctose-up dis- 
tance, for example, in small audience situations, the 
interlacing of the scan lines produces a visitde jitter 
effect which is unpleasant to the eye. If the tnteriaced 
display is viewed from a large distance, far example, in 
large audience situations, the jitter effect is less notice- 
afcrie. 

VGA-type video signals exist In a non-interlaced, 
format. This type of display is meant to be observed at a 
dose-up distance, for example, a couple of feet away in 
computer monitor environments. Since the V(]lA-type 
monitor is non-interlaced, the above-mentioned effect of 
jitter is not observed. However, due to the non-interlac- 
ing of scan lines, the monitor is difficult to view from a 
distance due to glare produced by concentated local 
intensities within a signal. 

Based on the above discussfon. it is clear that an 
interlaced display is ideal for large distance, for exam- 
ple, targe audience situations, and that a non-intalaced 
display is ideal for small distance, for exanple. small 
audience situations. Therefore, it would be useful to pro- 
vide for a vk:leo signal processing system where It is 
possible to provide a video signal output on either an 
NTSOtype monitor or a VGA-type monitor. 
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The object of the invention is to provkle a memory 
system for use in an image signal proces^ng system 
capable of handling a variety of image signal fbmiats 
and using a minimum amount of hardware so as to 
reduce costs of the overall system. 

The above object has been attained by the features 
as claimed In claims 1 and 4, namely by providing an 
inproved image overlay and rescan board capable of 
receiving image signals of a variety of formats including 
NTSC image signals representative of a real image and 
VGA image signals representative of a computer gener- 
ated graphics Inruige. The overiay and rescan board 
Includes a timing gate-anay for addressing a frame 
memory and for sending and receiving data to and from 
the frame memory. 

Both Image signals r^resentative of a real image 
and image signals representative of a conputer gener- 
ated graphics image are capable of being selectively 
received by and sent to the timing gate-array depending 
on the particular type of operation to be performed by 
tte overlay and rescan board. Possible operation off the 
board include conversion from computer graphics 
Image signals to image signals, r^resentative of real 
image (such as NTSC video) and vice versa, and over 
l^ng of computer graphics image signals onto image 
signals representative of real images and vice versa. 

Depending on the particular (deration to be can-ied 
out by the overlay and rescan board, the timing gate- 
anray either reads from or writes to the frame memory at 
a readAwrite rate dependent on the type of image signal 
to be read from or written to the frame memory. 

In this way. a single frame memory is capaWe of 
tempwarily storing an image signal of either a computer 
graphics type or a real image type. Thus, an overlay and 
rescan braid capable of pertbrming a variety off image 
processing operations having a minimum amount of 
hardware is achieved. 

In an ^rd^odlm&tt of the invention an NTSOtype 
video signal is overlaid onto a VGA-type signal as 
described above, and further, the overtaid signal Is fed 
to a line buffer which performs scan conversion of the 
overlaid signal. The scan-converted overtaid signal, 
which has been either scan-converted to the RGB or 
NTSC formats, is next displayed on either an RGB or 
NTSC, respectively, monitor. 

A still further object of the invention is to provide a 
video image processng system in which overtaid image 
signals, obtained by overtaying VQA-type image signals 
onto NTSC-type video signals or vice versa, may be 
easily stored to an external memory. 

By pladng a feedback connection from an output of 
a video image switcher, used to combine the signals 
making up the composite overiaW signal, back to an 
input of control means used to contrd tfie write in/iread 
out rate of an internal frame memory the first and sec- 
ond type of signals are overtaid. The overtaUl image, 
once formed, is fed back to the control means and 
storied into the ihterndf frame m«nory. Once the over- 



laid in^ge has been stored in the intwial frame m^- 
ory it may eaaly by read out and stored into an external 
memory at a transfer rate which the external memory 
can handle, i.e.. a transfer rate sub^antally less than 
5 the Megahertz (MHz) range rate at which the overtaid 
images are provided. 

BRIEF DESCRIPTiniy OF THE DRAWINr^ft 
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Ttie objects and features of the present invention 
will become more apparent from the conslderatipn of 
the following detailed description taken in conjurkSfon 
with the accompanying drawings In Which: 

Rg. 1 is a blod^ diagram schematically showing a 
prefen-ed embodiment of the vkleo signal mixing 
apparatus in accordance with the presM invention; 
Rg. 2 is a schmatic block diagram showing a spe- 
cific construction of an overiay and rescan lx)ard 
included in the illustrative embodiment; 
Rgs. 3 and 4 ea<^ ehow a ^«ific image whteh 
may be produced by the illustiBtive embodiment: 
Rg. 5 shows a specific format off video data applica- 
ble to the illustrative emfcKxlim^: 
Rg. 6 shows a conventional system for converting 
VGA signals to NTSC image signals; 
Rg. 7 shows a conventional system for converting 
NTSC to VQA image signals: 
Rg. 8 shows a conventional system for overtaying 
VQA onto NTSC image signals; 
Rgs. 9 and 10 each show a schematic Iriock dia- 
gram of a ^)eciffic cor^ttructidn of an timirig gate- 
array included in ttie illustrative embodiment; 
Rg. 1 1 shows a switcher gate-array of the Hiustra- 
tive embodiment: 

Rg. 12 shows a flow chart for etplairdngttie opera- 
tion of the switcher gate-array of tiie Illustrative 
OTbodiment; 

Rgs. 13 and 14 each show a specific index image 
data which may be produced by tiie illustrative 
embodiment; 

Rg. 15 Is a schematic blod^ diagram showing a 
specific cor^truction of an overiay and rescan 
board inched in the alternative emboc&nent; and 
Rg. 16 is a schematic block diagram showing a 
specific construction of an overiay and rescan 
board induded in another alternative embodiment 

DESCRIPTION QP TI^C PPCFERRED gMROpii, 
so MFNTS 

Referring to Rg. 1 of the drawings, a video or Image 
agnal mixing apparatus embodying the present inven- 
tion is shown and has a personal oonrputer 10 and a 
55 rec/|3layer 12 virWch are interconnected by an overiay 
and rescan board 14. The personal conputer 10 is a 
commerdally available 16-bit or 32-bit processor sys- 
tem and includes program sequences to handling 
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